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Abstract 

This paper develops a distributed algorithm for rate allocation in wireless networks that achieves 
the same throughput region as optimal centralized algorithms. This cross-layer algorithm jointly per- 
forms medium access control (MAC) and physical-layer rate adaptation. The paper establishes that this 
algorithm is throughput-optimal for general rate regions. In contrast to on-off scheduling, rate allocation 
enables optimal utilization of physical-layer schemes by scheduling multiple rate levels. The algorithm 
is based on local queue-length information, and thus the algorithm is of significant practical value. 

The algorithm requires that each link can determine the global feasibility of increasing its current 
data-rate. In many classes of networks, any one link's data-rate primarily impacts its neighbors and this 
impact decays with distance. Hence, local exchanges can provide the information needed to determine 
feasibility. Along these lines, the paper discusses the potential use of existing physical-layer control 
messages to determine feasibility. This can be considered as a technique analogous to carrier sensing 
in CSMA (Carrier Sense Multiple Access) networks. An important application of this algorithm is in 
multiple-band multiple-radio throughput-optimal distributed scheduling for white-space networks. 

Index Terms 

Wireless networks, Throughput-optimal rate allocation, Distributed algorithms 

I. Introduction 

The throughput of wireless networks is traditionally studied separately at the physical and 
medium access layers, and thus independently optimized at each of these two layers. As a 
result, conventionally, data-rate adaptation is performed at the physical layer for each link, and 
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link scheduling is performed at the medium access layer. There are significant throughput gains 
in studying these two in a cross-layer framework E71 . (HI, ifTTTl . Ifl9ll , JH. This cross-layer 
optimization results in a joint rate allocation for all the links in the network. 

Maximum Weighted (Max- Weight) scheduling introduced in the seminal paper [27] performs 
joint rate allocation and guarantees throughput-optimality^. However, Max- Weight algorithm 
and its variants have the following disadvantages, (a) It requires periodic solving of a possibly 
hard optimization problem, (b) The optimization problem is centralized, and thus introduces 
significant overhead due to queue-length information exchanges. Thus, in order to overcome these 
disadvantages, we need efficient distributed algorithms for general physical-layer interference 
models lfl9l 

The goal of this paper is to perform joint rate allocation in a decentralized manner. A 
related problem is distributed resource allocation in networks, and this problem has received 
considerable attention in diverse communities over years. In data and/or stochastic processing 
networks, resource-sharing is typically described in terms of independent set constraints. With 
such independent set constraints, the resource allocation problem translates to medium access 
control (or link scheduling) in wireless networks. For such on-off scheduling, recently, efficient 
algorithms have been proposed for both random access networks lfT2l . Il26ll and CSMA networks 
ETIl . ED. More recently, with instantaneous carrier sensing, a throughput-optimal algorithm with 
local exchange of control messages that approximate Max-Weight has been proposed in ll25l . 
and a fully decentralized algorithm has been proposed in lfT5l . The decentralized queue-length 
based scheduling algorithm in lfT5l and its variants have been shown to be throughput-optimal 
in 031, ||20ll . lfT3ll . This body of literature on completely distributed on-off scheduling has been 
extended to a framework that incorporates collisions in lfT6ll . ||24|| . Further, this decentralized 
framework has been validated through experiments in lfT8l . 

However, independent set constraints can only model orthogonal channel access which, in 
general, is known to be sub-optimal (Section 15.1). For wireless networks, the interaction 
among nodes require a much more fine-grained characterization than independent set constraints. 
This can be fully captured in terms of the network's rate region, i.e., the set of link-rates that 

'For cooperative networks, throughput-optimal rate allocation does not follow from classical Max-Weight scheduling. In 1171 . 
modified algorithms are developed for certain cooperative networks that guarantee throughput-optimality. 
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are simultaneously sustainable in the network. As long as the data-rates of links are within 
the rate region, simultaneous transmission is possible even by neighboring links in the network. 
Therefore, it is crucial to perform efficient distributed joint rate allocation (and not just distributed 
link scheduling) in wireless networks. Although distributed rate allocation is a very difficult 
problem in general, in this work, we show that this problem can be solved by taking advantage 
of physical-layer information. 

In this work, we consider single-hop^ wireless networks. We develop a simple, completely 
distributed algorithm for rate allocation in wireless networks that is throughput-optimal. In 
particular, given any rate region for a wireless network, we develop a decentralized (local queue- 
length based) algorithm that stabilizes all the queues for all arrival rates within the throughput 
region. Thus, we can utilize the entire physical-layer throughput region of the system with 
distributed rate allocation. To the best of our knowledge, this is the first paper to obtain such a 
result. This is a very exciting result as our decentralized algorithm achieves the same throughput 
region as optimal centralized cross-layer algorithms. The algorithm requires that each link can 
determine the global feasibility of increasing its data-rate from the current data-rate. In Section 
IVIII-Al we provide details on techniques to determine rate feasibility, and explain reasons for 
using this approach in practice. 

The framework developed in this paper generalizes the distributed link scheduling framework. 
As discussed before, the current distributed link scheduling algorithms primarily deal with binary 
(on-off) decisions whereas our algorithm performs scheduling over multiple data-rates. Similar 
to these existing distributed link scheduling algorithms, our algorithm is mathematically modeled 
by a Markov process on the discrete set of data-rates. However, with multiple data-rates for each 
link, the appropriate choice of the large number of transition rates is very complicated. Thus, 
a key challenge is to design a Markov chain with fewer parameters that can be analyzed and 
appropriately chosen for throughput-optimality. We overcome this challenge by showing that 
transition rates with the following structure have this property. For link i, the transition rate to 
a data-rate from any other data-rate is exp(r ij ?; i ), where Vi is a single parameter associated 
with link i that is updated based on its queue-length. The transition takes place only if the 

2 For networks that do not employ cooperative schemes, the results in this paper are likely to generalize using multi-hop by 
combining "back-pressure" with the algorithmic framework of this paper. 
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new data-rate is feasible. As expected, this reduces to the existing algorithmic framework in the 
special case of binary (on-off) decisions. 

For the general framework mentioned above, at an intuitive level, the techniques required 
for proving throughput-optimality remain similar to existing techniques. However, there are few 
additional technical issues that arise while analyzing the general framework. First, we need to 
account for more general constraints that arise from the set of possible rate allocation vectors. 
Next, the choice of update rules for Vi (t) with time t based on local queue-lengths that guarantee 
throughput-optimality does not follow directly. The mixing time of the rate allocation Markov 
chain plays an important role in choosing the update rules. For arbitrary throughput regions, any 
rate allocation algorithm that approach e-close (for arbitrarily small e) to the boundary possibly 
requires an increasing 1/e number of data-rates per link. This leads to a potential increase in 
the mixing time due to the increase in the size of the state-space. Thus, the analysis performed 
in this paper is more general and essential to establish throughput-optimality of the algorithms 
considered. 

An important application of this algorithmic framework is for networks of white-space radios 
0, where multiple non-adjacent frequency bands are available for operation and multiple radios 
are available at the wireless nodes. A scheduler needs to allocate different radios to different 
bands in a distributed manner. This problem introduces multiple data-rates for every link even 
in the CSMA framework, and hence, existing distributed algorithms cannot be directly applied. 
We demonstrate that our framework provides a throughput-optimal distributed algorithm in this 
setting. 

Our main contributions are the following: 

• We design a class of distributed cross-layer rate allocation algorithms for wireless networks 
that utilize local queue-length and physical-layer measuring. 

• We show that there are algorithms in this class that are (a) throughput-optimal, and (b) 
completely decentralized. 

• We demonstrate that an adaptation of these algorithms are throughput-optimal for multiple- 
band multiple-radio distributed scheduling. 
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TABLE I 
Basic Notation 



i(0 


Indicator function 


a- b 


Dot product of vectors a and b 


NU 


Lp-norm of vector a 


l|a||o 


Number of non-zero elements of a 


H 


Absolute value for scalars, 
Cardinality for sets 


E[-] 


Expectation operator 


K+ 


Non-negative reals 


Z+ 


Non-negative integers 


Z++ 


Strictly positive integers 


ej 


Unit vector along i-th dimension, i.e., 

e; 6 {0, 1}™ with i-th component equal to 1 

and all other components equal to 



A. Notation 

Vectors are considered to be column vectors and denoted by bold letters. For a vector a and 
matrix B, &B := & T B, where a T is the transpose of a. For vectors, <, >, <, > and = are 
defined component-wise. denotes all-zeros vector and 1 denotes all-ones vector. Other basic 
notation used in the paper is given in Table H Notation specific to proofs is introduced later as 
needed. 

B. Organization 

The next section describes the system model. Section QII] explains the distributed rate allocation 
algorithm. Section [IV] introduces relevant definitions and known results. Section [V] describes 
the rate allocation Markov chain and the optimization framework. Section [VI] establishes the 
throughput-optimality of the algorithm. The algorithm for multiple-band multiple-radio schedul- 
ing is given in Section IVIII Further discussions and simulation results are given in Section IVIIII 
We conclude with our remarks in Section HX] For readability, the proofs of the technical lemmas 
in Section |V] and Section |VI] are moved to the Appendix. 



April 7, 2010 



DRAFT 



6 



II. System Model 



Consider a wireless network consisting of m nodes, labeled J\f := {1,2, ... ,m}. In this 
network, we are interested in n single-hop flows that correspond to n wireless links labeled 
C := {1,2, ... ,n}. Since we have a shared wireless medium, these links interact (or interfere) 
in a potentially complex way. For single-hop flows, this interaction among links can be captured 
through a n-dimensional rate region for the network, which is formally defined next. 

Definition 1 (Rate Region): The rate region of a network is defined as the set of instanta- 
neous rate vectors c G K™ at which queues (introduced later) of all n links can be drained 
simultaneously. 

In this paper, we assume that the rate region is fixecj^l (i.e., not time- varying). We denote the 
rate region associated with the network by C C R". By definition, this rate region is compact. 
We assume that the rate region has the following simple property: if c G C, then c G C for all 
c < c and c > 0. The above property states that rates can be decreased component-wise. Such 
an assumption is fairly mild, and is satisfied by rate regions resulting from most physical-layer 
schemes. Next, we define the throughput region of the network. 

Definition 2 (Throughput Region): The throughput region of a network, denoted by T, is 
defined as the convex hull of the rate region C of the network. 

We use a continuous-time model to describe system dynamics. Time is denoted by t G M+. 
Every (transmitter of) link i G C is associated with a queue Qi(t) G R+, which quantifies the 
information (packets) remaining at time t waiting to be transmitted on link i. Let the cumulative 
arrival of information at the i-th link during the time interval [0, t) be Ai(t) G R+ with Aj(0) := 0. 
Rate allocation at time t is defined as the rate vector in the rate region at which the system is 
being operated at time t. Let the rate allocation corresponding to the i-th link at time t be Vi(t). 
Then, for every link i G C, the queue dynamics is given by 



where < s < t. The vector of n queues in the system is denoted by Q(t) := [Qi(t)]™ =1 . The 
queues are initially at Q(0) G R". 

We consider arrival processes at the queues in the network with the following properties. 

3 We consider fixed or slow-fading channels. 




(1) 
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• We assume every arrival process is such that increments over integral times are independent 
and identically distributed with Pr(v4j(l) = 0) > 0. 

• We assume that all these increments belong to a bounded support [0, K], i.e., Ai(k + 1) — 
Ai(k) E [0, K] for all k E Z+. 

Based on these properties, the (mean) arrival rate corresponding to the z-th link is A, := E[A i (l)]. 
We denote the vector of arrival rates by A. Without loss of generality^, we assume A m j n : = 
minj A, > 0. It follows from the strong law of large numbers that, with probability 1, 

lim ^ = Aj. (2) 

In summary, our system model incorporates general interference constraints through a arbitrary 
rate region and focuses on single-hop flows. We proceed to describe the rate allocation algorithm 
and the main results of this paper. 

III. Rate Allocation Algorithm & 
Main Results 

The goal of this paper is to design a completely decentralized algorithm for rate allocation 
that stabilizes all the queues as long as the arrival rate vector is within the throughput region. 
By assumption, every link can determine rate feasibility, i.e., every link can determine whether 
increasing its data-rate from the current rate allocation results in a net feasible rate vector. More 
formally, every link % E C at time t, if required, can obtain the information I(r(£) + aej E 
C), for any a E R. More details on determining rate feasibility are given in Section fVIIIl 

The rate allocation vector at time t is denoted by r(t) := [ri(t)]f =1 . For decentralized rate 
allocation, we develop an algorithm that uses only local queue information for choosing r(t) 
over time t. Further, we perform rate allocation over a chosen limited (finite) set of rate vectors 
that are feasible. We choose a finite set of rate levels corresponding to every link, and form 
vectors that are feasible. The details are as follows: 

1) For each link % E C, a set of rate levels IZi = {^tj}jL ^ cnosen from [0, q] with 
r i = 0, r j & . = Q and Uj-x < r i: j. Here, q is the maximum possible transmission rate 
for the i-th link, i.e., q := argmaxQ, g R + ae^ E C, and h t E Z ++ is the number of levels 

4 lf \i = 0, then this link can be removed from the system. 
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other than zero. Since the rate region is compact, without loss of generality^, we assume 

< K < a < K < oo. 

2) The set of rate allocation vectors, denoted by TZ, is given by TZ = {[r 1 , r 2 , . . . , r n ] : r, G 
TZi for all % G C, and [r 1; r 2 , . . . , r n ] G C}. 

The convex hull of the set of rate allocation vectors 1Z is denoted by 1Z C . Define TZ° = 
{r G K™ : r < t for some t G TZ C }, the set of strictly feasible rates. For rate regions that are 
polytopes, the partitions TZi can be chosen such that 7Z C = T. For any compact rate region, it 
is fairly straightforward to choose partitions TZi with ki < [2cj/e] < |~2A'/e] such that c G TZ C 
if c + |1 G T. The trivial partition with e/2 as step size in all dimensions satisfy the above 
property. Thus, for any given e > 0, we can obtain a set of rate allocation vectors TZ such that 



and c G TZ C if c + §1 G T. 

Before describing the algorithm, we define two notions of throughput performance of a rate 
allocation algorithm. 

Definition 3 (Rate stable): We say that a rate allocation algorithm is rate-stable if, for any 
A G TZ°, the departure rate corresponding to every queue is equal to its arrival rate, i.e., for all 
i G £, with probability 1, 



Definition 4 (Throughput optimal): We say that a rate allocation algorithm is throughput- 
optimal if, for any given e > 0, the algorithm makes the underlying network Markov chain 
positive Harris recurrent (defined in Section HVl) for all A such that A + el G T. By definition, 
the algorithm can depend on the value of e. 

Next, we describe a class of algorithms to determine r(t) as a function of time based on a 
continuous-time Markov chain. Recall that TZi = {rij}^' =0 is the set of possible rates/states for 
allocation associated with the i-th link. In these algorithms, the i-th link uses ki independent 

5 If a — 0, then this link can be removed from the system. 



TZ\ < \2K/e\ 



n 



(3) 




From ©J©, this is same as, for all i G C, with probability 1, 



lim Qi(t)/t = 0. 
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Fig. 1. Gaussian Multiple Access Channel 




Y = X 1 + X 2 + Z 



exponential clocks with rates/parameters^! {Uij}^ l =0 (or equivalently exponential clocks with 



mean times {1/Uij}^t. ). The clock with (time varying) parameter U it j is associated with the 
state Ti j. Based on these clocks, the 2-th link obtains r^t) as follows: 

1) If the clock associated with a state (say j = m) ticks and further if transitioning to that 
state r^ m is feasible, then rj(i) is changed to r i m ; 

2) Otherwise, rj(t) remains the same. 

The above procedure continues, i.e, all the clocks run continuously. Define Uij := log[/jj,Vi G 
C, j G {0, 1, ... , ki}. It turns out that the appropriate structure to introduce is as follows: 

u i,j = r i,j v ii W e C,j e {0,1, ... , ki}, 
where i>i G R, Vz G C. We denote the vector consisting of these new set of parameters by 

Example 1: Consider a Gaussian multiple access channel with two links as shown in Figure 
CD with average power constraint P at the transmitters and noise variance N at the receiver. The 
capacity region of this channel is shown in Figure |2] where C(x) = 0.51og 2 (l + x). In this 
case, orthogonal access schemes limit the throughput region to the triangle (strictly within the 
pentagon) shown using dash-line. In this example, if we allow for capacity-achieving physical- 
layer schemes, the rate region (and hence the throughput region) is identical to the pentagon 
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Fig. 2. Information-theoretic Capacity Region 

shown in Figure [2l The natural choice for the set of rate levels at link-1 is IZi = {0, a, b} 
where a = C(P/P + N) and b = C(P/N). Similarly, TZ 2 = {0,a,b}. This leads to the set of 
rate allocation vectors 1Z — {[0, 0], [0, a], [0, b], [a, 0], [a, a], [a, b], [b, 0], [6, a]}. It is clear that the 
convex combination of this set is the throughput region itself. For this example, the state-space 
of the Markov chain and transitions to and from state (b, a) are shown in Figure [31 

A distributed algorithm needs to choose the parameters v in a decentralized manner. For 
providing the intuition behind the algorithm, we perform this in two steps. In the first step, we 
develop the non- adaptive version of the algorithm that has the knowledge of A. This algorithm 
is called non-adaptive as the algorithm requires the explicit knowledge of A. The rate allocation 
at time t = is set to be r(0) = 0. This algorithm uses v* at all times which is a function of 
A, and is given by 



We show in Section |V] that, given A e 1Z°, the above optimization problem has a unique solution 
that is finite, and therefore has a valid v*. An important result regarding this non-adaptive 
algorithm is the following theorem. 
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Fig. 3. Rate Allocation Markov Chain (transitions to/from (b, a) state alone shown) 

Theorem 1: The above non-adaptive algorithm is rate-stable for any given A G 1Z°. 

Proof Outline: For any A G 1Z°, there is at least one distribution on 1Z that has expectation 
as A. For the Markov chain specified by any v G M. n , there is a stationary distribution on the 
state-space 1Z. The value v* is chosen such that it minimizes the Kullback-Leibler divergence 
of the induced stationary distribution from the distribution corresponding to A. For the Markov 
chain specified by v*, the expected value of the stationary distribution turns out to be A. This 
leads to rate-stable performance of the algorithm. The proof details are given in Section |V] ■ 

In the second step, we develop the adaptive algorithm, where v is obtained as a function 
of time t denoted by v(tjz[ This algorithm is called adaptive as the algorithm does not require 
the knowledge of A. The values of v(t) are updated during fixed (not random variables) time 
instances 77 for I G Z ++ . We set r = and v(0) = 0. During interval t G [r h r^ +1 ) the algorithm 
uses v(t) = v(t/). The length of the intervals are TJ = n +1 — rj. During interval [ti,ti + \), let 
the empirical arrival rate be 

*,(/) = M ™\ Mn) (4) 

+ l 

7 This implies that the exponential clocks used have time varying rates. These are well-defined non-homogeneous Poisson 
processes. 



April 7, 2010 



DRAFT 



12 



and the empirical offered service rate be 



i r i+i 

Sill) = — r { {z)dz. (5) 



71 „ 

The update equation corresponding to the algorithm for the z-th link is given by 



Vi(n+i) = Vi(n) + ai (%(0 + | - Si(Z)j 



(6) 

J D 

where = min(0, .0)1(0 > 0) + max(0, -£>)I(0 < 0), i.e., [9] D is the projection of 9 to the 
closest point in [—D,D], and a>i are the step sizes. Thus, the algorithm parameters are interval 
lengths Ti, step sizes on and D. 

Remark 1: Clearly, both empirical arrival rate and empirical offered service rate used in the 
above algorithm can be computed by the z-th link without any external information. In fact, the 
difference is simply the difference of its queue-length over the previous interval appropriately 
scaled by the inverse of the length of the previous interval. 

The following theorem provides e-optimal performance guarantee for the adaptive algorithm. 

Theorem 2: Consider any given e > 0, e < 4A„ H „. Then, there exists some choice of algorithm 
parameters 7] = T(n, e),ai = a(n, e) and D = D(n, e) such that the appropriate network Markov 
chain under the adaptive algorithm is positive Harris recurrent if A + el G T, i.e., the algorithm 
is throughput-optimal. 

Proof Outline: The update in © can be intuitively thought of as a gradient decent technique 
to solve an optimization problem that will lead to v* whose induced stationary distribution on 1Z 
has expected value strictly greater than A. However, the arrival rate and offered service rate are 
replaced with their empirical values for decentralized operation. We consider the two time scales 
involved in the algorithm - update interval T and iV update intervals. The main steps involved 
in establishing the throughput-optimality are the following. First, we show that, sufficiently long 
T can be chosen such that the empirical values used in the algorithm are arbitrarily close to 
the true values. Using this, we next show that the average offered empirical service rate over 
TV update intervals is strictly higher than the arrival rate. Finally, we show that this results in 
a drift that is sufficient to guarantee positive Harris recurrence. The proof details are given in 
Section I 
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IV. Definitions & Known Results 

We provide definitions and known results that are key in establishing the main results of 
this paper. We begin with definitions on two measures of difference between two probability 
distributions. 

Definition 5 (Kullback-Leibler (KL) divergence): Consider two probability mass functions % 
and fi on a finite set X. Then, the KL divergence from ix to \l is defined as D(p\\ti) = 

Definition 6 (Total Variation): Consider two probability mass functions 7r and p on a finite set 
X. Then, the total variation distance between ir and /i is defined as \\p — ti\\tv = \ Exe* IM X ) ~~ 

7T(X)|. 

Next, we provide two known results that are used later. Result \T\ follows directly from 
[H (Theorem 3.2), and Result |2] is in [H (Theorem 4.3). 

Result 1 (Mixing Time): Consider any finite state-space, aperiodic, irreducible, discrete-time 
Markov chain with transition probability matrix P and the stationary distribution ct. Let a m „, 
be the minimum value in a. and the second largest eigenvalue modulus (SLEM) be o max . Then, 
for any p > 0, starting from any initial distribution (at time 0), the distribution at time r £ Z ++ 
associated with the Markov chain, denoted by /3(t), is such that ||/3(r) — ct\\ TV < p if 

\ log(l/a; mM ) + log(l/p) 

l0g(l/ (Tmax) 

Result 2 (Conductance Bounds): Consider the setting as above. The ergodic flow out of S C 
X is defined as F(S) := Exes xes c «(x)P(x, x) and the conductance is defined as 



^ min {ESr* c5c *'§ a(x)£ 5}- (8) 

Then, the SLEM a max is bounded by conductance as follows: 

1 - 2$ < o max < 1 - $ 2 /2. (9) 

Lastly, we provide the definition of positive Harris recurrence. For details on properties 
associated with positive Harris recurrence, see Il22l . Il6l . 

Definition 7 (Positive Harris recurrence): Con-sider a discrete-time time-homogeneous Markov 
chain on a complete, separable metric space X. Let Bx denote the Borel a-algebra on X, and 
X T denote the state of the Markov chain at time r £ Z + . Define stopping time T4 := inf{r > 
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: X T E A} for any A E Ex- The set A is called Harris recurrent if Py{Ta < oo\X(0) = x) = 1 
for any x E X. A Markov chain is called Harris recurrent if there exits a cr-finite measure /x on 
(X, Ex) such that if fJ,(A) > for some A E then A is Harris recurrent. It is known that 
if X is Harris recurrent an essentially unique invariant measure exists. If the invariant measure 
is finite, then it may be normalized to a probability measure. In this case, X is called positive 
Harris recurrent. 



Rate allocation Markov chain: The main challenge is to design a Markov chain with fewer 
parameters that can be analyzed and appropriately chosen for throughput-optimality. First, we 
identify a class of Markov chains that are relatively easy to analyze. Consider the class of 
algorithms introduced in Section |nij The core of this class of algorithms is a continuous-time 
Markov chain with state-space TZ, which is the (finite) set of rate allocation vectors. Define 



where r = [r 1} r 2 , . . . , r n ] E TZ, r = [r l5 r 2 , . . . , r n ] E 71 and u it j are the parameters introduced 
in Section Unl Now, the transition rate from state f E TZ to state r E TZ can be expressed as 



And, the diagonal elements of the rate matrix are given by g(r, f) = — J2ren r^f r ) f° r a ^ 
r E TZ. This follow directly from the description of the algorithm. This class of algorithms are 
carefully designed such that it is tractable for analysis. In particular, the following lemma shows 
that this Markov chain is reversible and the stationary distribution has exponential form. 

Lemma 3: The rate allocation Markov chain (TZ, q) is reversible and has the stationary distri- 
bution 



Furthermore, this Markov chain converges to this stationary distribution starting from any initial 
distribution. 



V. Rate allocation Markov chain & Rate Stability 




(10) 





(11) 
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Proof: The proof follows from detailed balance equations 7r(r)g(r, r) = 7r(r)g(f, r) for 
all r,f G K and known results on convergence to stationary distribution for irreducible finite 
state-space continuous-time Markov chains H). ■ 
The offered service rate vector under the stationary distribution is s := J2 r en 7r( r ) r - I n general, 
for A G 1Z°, we expect to find values for parameters uy as a function of A and 1Z such that 
s = A. Due the exponential form in (|30l) . it turns out that the right structure to introduce is 

u i,j = r i,j v i,Vi e £, j G {0, 1, . . . ,ki}, (12) 

where Vi G R, Vi G C, and obtain suitable values for v = [i>i]" =1 as a function of A and 1Z such 
that s = A. To emphasize the dependency on v, from now onwards, we denote the stationary 
distribution by 7r v (r) and the offered service rate vector by 

s v = ^7r v (r)r. (13) 

rG7£ 

Substituting (fT2"l) . we can simplify (l30l) to obtain 

Mr) = v eXP(r ', V) (14) 
Ef G 7e exp(r ■ v) 

Optimization framework: We utilize the optimization framework in lfT5l to show that values 
for v exist such that s v = A. In particular, we show that the unique solution to an optimization 
problem given by v* has the property s v . = A. Next, we describe the intuitive steps to arrive 
at the optimization problem. If A G 1Z°, then A can be expressed as a convex combination 
of r G 1Z, i.e., there exists a valid probability distribution ^(r) such that A = Xlre^' u ( r ) r - 
For a given distribution //(r), we are interested in choosing v such that 7r v (r) is close to 
/x(r). We consider the KL divergence of 7r v (r) from /i(r) given by D (/i(r)||7r v (r)). Minimizing 
D (/i(r)||7r v (r)) over the parameter v is equivalent in terms of the optimal solution(s) to max- 
imizing F(/i(r), 7r v (r)) := — D (/z(r)||7r v (r)) — H(n(r)) over the parameter v as i/(/i(r)) is a 
constant. Simplifying F(/i(r), vr v (r)) leads the optimization problem as follows: 



F(/x(r),7r v (r)) = ^/i(r)log7r v (r) 

M r ) r • v - log ( ^2 exp(r • v) 



(a) 



(6) 



rell \reil 
A ■ v — log I exp(r • v) 
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Here, (a) follows from (fT4l) and (6) follows from the assumption A = J2refc / ti ( r ) r - Now onwards, 
we denote the objective function by F(v, A). To summarize, the optimization problem of interest 
is, given A G 72.°, 



The following lemma regarding the optimization problem in (fl"5l) is a key ingredient to the 
main results. 

Lemma 4: Let A G 1Z°. The optimization problem in (fl"5l) has a unique solution v*(A), which 
is finite. In addition, the offered service rate vector under v* is equal to the arrival rate vector, 
i.e., s v » = A. 

Proof: See Appendix. ■ 
The important observations are that the objective function is concave in v and the gradient with 
respect to v is A — s v . With offered service rate equal to arrival rate, the next step is to show 
that the queues drain at rate equal to A. 

A. Proof of Theorem [7] 

Rate stability of the non-adaptive algorithm: We establish the rate stability of the non- 
adaptive algorithm with the result given in Lemma |4] as follows. 

Consider time instances vi for I G Z + with u = 0, and interval length T; := ui +1 — v\ =1 + 1. 
The queue at the i-th link can be upper bounded as follows. The offered service during the 
time interval is [u k , fk+i) is used to serve the arrivals during the time interval v k ) alone. 

Consider a time t, and choose I such that t G [ui, i^+i). Using (OQ) and the above upper bounding 
technique, we obtain 



maximize F(v, A) = A • v — log (^ re ^exp(r • v)) 



(15) 



subject to 





1-2 



+Ai(t) - Ai(vi-x), 



(16) 



where [9} + = max(0, 9). 
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For each interval [u k , u k+ i), define the following two random variables: 

ati{k) := - , and 

J- k 

I r v k+i 
/3i(k) := — / ri(z)dz. 



It follows from the strong law of large numbers that, with probability 1, lim^oo a.i(k) = A,. 
From Lemma |4] and ergodic theorem for Markov chains, it follows that, with probability 1, 
lim^oo f3i(k + 1) = Aj. Since the arrival process Ai(t) is non-decreasing and the increments are 
bounded by K, we have 

< K(vi +X - n-i) 

= K{V l _ l + T l ). (17) 

Rewriting (TT6l) with above defined random variables and applying (fT7l) along with v\ < t and 

T/t < Tfe+i, we obtain 

l— 2 

^5 < i^r fe KA;)-A(A;+l)] + 

fc=0 

+ ^ r '-' +r '). (18) 

In (fT8l) . the second term on the right hand side (RHS) goes to zero as Ti/vi — > as I — > oo. 
The first term on the RHS of ( TT8T ) goes to zero with probability 1 as a^/c) — f3i(k + 1) — > 0, 
i/j > 52^=0^ and z// — >■ cxd. Thus, for any given A G 1Z°, with probability 1, 

t— >oo t 

which completes the proof. ■ 
This result is important due to the following two reasons. 

1) The result shows that this algorithm has good performance, and an algorithm that ap- 
proaches the operating point of this algorithm has the potential to perform "well." Essen- 
tially, this aspect is utilized to obtain the adaptive algorithm. 

2) The non-adaptive algorithm does not require the knowledge of the number of nodes or e, 
as required by the adaptive algorithm. This suggests the existence of similar gradient-like 
algorithms that perform "well" with different algorithm parameters that may not depend on 
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the number of nodes or e. We do not address this question in the paper, but the non-adaptive 
algorithm will serve as the starting point to address such issues. 



VI. Throughput Optimality of Algorithm 

In this section, we establish the throughput-optimality of the adaptive algorithm for a particular 
choice of parameters. The algorithm parameters used in this section are dependent on the number 
of links n and e. It is evident from the theorem that e determines how close the algorithm is to 
optimal performance. Define 

'K 2 n 2 
h n 



C(n) := 3 5 (2K + K)' 
We set all the step sizes (irrespective of interval) to 

ai = a(n,e) := e 2 /C(n), 

and D used in the projection to 



D = D(n,e) := — — log 
A e 



2K 



+ K. 



All the interval lengths (irrespective of interval) are set to 

( * ( ti 2 n 
Ti = T(n, e) := exp \Ki— log - 



(19) 



(20) 



(21) 



for some large enough constant K > 0. 

Remark 2: The large value of T(n, e) in (I2TI) is due to the poor bound on the conductance of 
the rate allocation Markov chain. The parameters given by (fl9l) , (l20l) and (1211) are one possible 
choice of the parameters. We would like to emphasize that this choice is primarily for the purpose 
of the proofs. The choice of right parameters (and even the update functions) in practice are 
subject to further study especially based on the network configuration and delay requirements. 
Some comments on this are given in Section IVIIIl 

We start with the optimization framework developed in the previous section. For the adaptive 

1 e K c , 



algorithm, the relevant optimization problem is as follows: given A such that A T ^ 



maximize F e (v) : = 
subject to v G M n . 
The following result is an extension of Lemma 0] 



F v,A 



4" 



(22) 
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Lemma 5: Consider any given e > and A. Then, the optimization problem in (1221) is strictly 
concave in v with gradient VF e (v) = A + |1 — s v and Hessian 

H(F{v)) = - (E Wv [rr T ] - E Wv [r] E nv [r T ]) . 

Further, let A+ |1 G 7Z C . Then, it has a unique solution v*, which is finite, such that the offered 
service rate vector under v* is equal to A + 41, i.e., s v * = A + |1. In addition, if e < 4A mi -„, 
then the optimal value v* is such that 

16Kn 



oo < —p — log 

K € 



2K 



(23) 



Proof: See Appendix. ■ 
The update step in ©, which is central to the adaptive algorithm, can be intuitively thought 
of as a gradient decent technique to solve the above optimization problem. Technically, it is 
different as the arrival rate and offered service rate are replaced with their empirical values for 
decentralized operation. The algorithm parameters can be chosen in order to account for this. 
This forms the central theme of this section. 



A. Within update interval 

Consider a time interval [r ; ,r/ +1 ). During this interval the algorithm uses parameters ^(tj). 
For simplicity, in this subsection, we denote Ui(rj) by and the vector by v and E[-|v] by E[-]. 
For the rate allocation Markov chain (MC) introduced in Section |Vj we obtain an upper bound 
on the convergence time or the mixing time. 

To obtain this bound, we perform uniformization of the CTMC (continuous-time MC) and use 
results given in Section [IV] on the mixing time of DTMC (discrete-time MC). The uniformization 
constant used is A := riexp(_S'||v|| 00 ). The resulting DTMC has the same state-space 1Z with 
transition probability matrix P. The transition probability from state r G 1Z to state r G 1Z, r ^ r 
is P(t, r) = q(r, r) /A, and from state r G 1Z to itself is P(r, r) = l + q(r, r) /A. With our choice 
of parameters u it j given by (fT2l) . we can simplify (flOl) to 

/(r, r) = exp \ r^Ifa ^ f^J . (24) 

For all r, r G 1Z, r ^ f , clearly q(r , r) < exp(X||v|| (X) ). Since at most n elements in every row 
of the transition rate matrix of the CTMC is positive |g(f, f)| < A for all f G 1Z. Therefore, P 
is a valid probability transition matrix. 
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The DTMC has the same stationary distribution as the CTMC. In addition, the CTMC and 
the DTMC have one-to-one correspondence through an underlying independent Poisson process 
with rate A. In this subsection, time t denotes the time within the update interval, i.e., t — 
denotes global time 77. Let fi(t) be the distribution over 1Z given by the CTMC at time t, and 
C be a Poisson random variable with parameter At. Then, we have 

= fj,(0) exp(At(P — J)), (25) 

where I is the identity matrix. Next, we provide the upper bound on the mixing time of the 
CTMC. 

Lemma 6: Consider any p 1 > 0. Then, there exists a constant K 1 > 0, such that, if 

t > exp ( Ki ( nllvlloo + nlog- J J log—, (26) 



e // Pi 

then the total variation between the probability distribution fjt(t) at time t given by (|25T) and the 
stationary distribution 7r v given by (fl4l) is smaller than pi, i.e., — 7r v || T y < p\. 

Proof: See Appendix. ■ 

Lemma [6] is used to show that the error associated with using empirical values for arrival rate 
and offered service rate in the update rule © can be made arbitrarily small by choosing large 
enough T. This is formally stated in the next lemma. 

Lemma 7: Consider p 2 > 0. Then, there exists a constant K 2 > 0, such that, if the updating 
period 

T > exp ^ 2 ^||v||oo + rilog^J J y, 
then for any time interval [77, T; + i) 



E 



A(/)-A +E[||s(0 -SvllJ <p 2 . (27) 



Proof: See Appendix. ■ 
Thus, the important result is that due to the mixing of the rate allocation Markov chain, the 
empirical offered service rate is close to the offered service rate. The next step is to address 
whether the offered service rates over multiple update intervals is higher than the arrival rates. 
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B. Over multiple update intervals 

We consider multiple update intervals, and establish that the average empirical offered service 
rate is strictly higher than the arrival rate. This result follows from the observation that, if 
the error in approximating the true values by empirical values are sufficiently small, then the 
expected value of the gradient of F e {y) over sufficiently large number of intervals should be 
small. In this case, we can expect the average offered service rate to be close to s v » . Since, s v * 
is strictly higher than arrival rates, we can expect the average offered service rate to be strictly 
higher than the arrival rate. The result is formally stated next. 

Lemma 8: Consider N(n,e) := (7 x 3 5 n_D 2 )/(«e 2 ) update intervals. Then, the average of 
empirical service rates over these update intervals is greater than or equal to A + |1, i.e., 

1 N 

^E[s(/)]>A + fl. 

1=1 

Proof: See Appendix. ■ 
Now, we proceed to show that the appropriate 'drift' required for stability is obtained. 



C. Proof of Theorem [2] 

Consider the underlying network Markov chain X(l) consisting of all the queues in the 
network, the update parameters, and the resulting rate allocation vectors at time 77, i.e., X(l) = 
(Q(tj), v(r{), r(r{)) for I E Z+. It follows from the system model and the algorithm description 
that X{1) is a time-homogenous Markov chain on an uncountable state-space X. The cr-field 
on X considered is the Borel a-field associated with the product topology. For more details on 
dealing with general state-space Markov chains, we refer readers to ll22ll . 

We consider a Lyapunov function V : X — > K + of the form, V(x) = Yli=i(Qi + v f + r i) f° r 
x = (Q, v, r). In order to establish positive Harris recurrence, for any A such that A + el G T, 
we use multi-stepj Lyapunov and Foster's drift criteria to establish positive recurrence of a set 
of the form V(x) < k, for some k > 0. From the assumption on the arrival processes, it follows 
that V(x) < k is a closed petite set (for definition and details see E2l . lfT3l ). It is well known 
that these two results imply positive Harris recurrence ll22ll . 

8 This is a special case of the state-dependent drift criteria in 1221 . 
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Next, we obtain the required drift criteria. For simplicity, we denote E[-|X(0)] by E[-] in the 
rest of this section. Consider 

E[Q 2 (TN)-Q 2 {0)} = E[(Qi(TN)-Qi(0)) 2 

+2Q i (0)(Q i (TN) - Q^O))] 

(a) 

< (max(K, K)TN) 2 + 

2Q i (0)E[Q i (TN) - Qi(0)}. 

Here, (a) follows from the fact that over unit time queue difference belong to [—K,K]. Now, 
we look at two cases. If Qi(0) > KTN, clearly Qi(t) > during interval [0,TN] as service 
rate is less than or equal to K. For this case, from Lemma [8l 

/ N 

2Q i (0)E[Q i (7W)-Q i (0)] = 2Q i (0)T J^-Ef^ 

\i=i 

< —TNQ^O) + e -K{TNf. 

Here, (a) is trivial, but the extra term is added to ensure that the RHS evaluates to a non- 
negative value for Qi(0) < KTN. If Q;(0) < KTN, then clearly 2Q i (0)E[Q i ( y TN) - Q;(0)] < 
2KK(TN) 2 . Since the bounds for each case do not evaluate to negative values for the other 
case, we have 

E[Q?(7W) - Q 2 M\ < —TNQiiO) + ((K + K) 2 + ^K)(TN) 2 . 
Since both v and r are bounded, there exists some fixed M(n, e) such that 
E[v 2 (TN) - v 2 (0)] + E[r 2 (TN) - r 2 (0)] < M(n, e). 
Summing up over all i E C, we obtain 

E[V(X(N)) - V(X(0))] < -"-TN ( jrqm 

\i=l / 

+nM(n, e) + n {{K + K) 2 + ^i?) (TN) 2 . 

This shows that there exists some k > such that for all x with V(x) > n there is strict negative 
drift. Hence, the set V(x) < n is positive recurrent. Since A + |1 G 1Z C , clearly X + el E T. 
This completes the proof of Theorem [21 ■ 
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In summary, given any rate region for a wireless network, the (queue-length based) algorithm 
has e-optimal performance. 

VII. Applications: White- space Networks 

An important application of our algorithmic framework is in the domain of white-space 
networks ll23l . ifTOll . White- space radios are typically required to sense the environment [|9l . 
Therefore, these radios are designed with highly accurate sensing capabilities. Even though 
these are primarily designed for sensing the presence of primary radios, the same capability can 
exploited for sensing secondary radios. In this section, we consider a networks of secondary 
nodes that use the same spectrum, but different from that used by primary nodes. In particular, 
we assume that the secondary nodes have already found spectrum that are not utilized by primary 
nodes. 

Since such a white-space network of secondary nodes are not centrally controlled, it is desirable 
to obtain simple distributed algorithms. However, the scheduling problem in these white-space 
networks is different from the link scheduling problem in traditional wireless networks 0. First, 
the available spectrum for the operation of this network is fragmented with different propagation 
characteristics. Second, these secondary nodes are usually equipped with multiple radios to 
operate simultaneously in different bands. This is referred to as the multiple-band multiple-radio 
scheduling problem. Next, we describe the multiple-band multiple-radio scheduling problem in 
detail. 

Consider the network model introduced in Section lU Define functions s : C i— > N that maps 
links to source nodes, and d : C !->■ J\f that maps links to destination nodes. The available 
spectrum for the operation of this network is fragmented. The spectrum consists of M bands, 
labeled B = {1,2,..., M}, with bandwidths Bi, B 2 , . . . , B M . The transmission from a node 
to another node gets different spectral efficiencies on different bands. For a link i, let be 
the spectral efficiency that node s(i) gets when it transmits on band b to node d(i). The link 
interference graphs are also different on different bands. Let Qb = (£, £&) be the link interference 
graph on band b, i.e, the transmission of link u interfere with the transmission of link v in band 
b if (u, v) E £b- We assume that the link interference is symmetric, i.e., if (u, v) E £& then 
(v,u) E £b- These capture the frequency dependent propagation characteristics and the spatial 
variation of the quality of spectrum. Further, each node j is equipped with a, radios. 
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At time t, the decision whether link i is operated in band b is represented by binary decision 
variables a i:b (t), with 1 representing "true" and representing "false". The decision variables has 
to satisfy the constraints that arise from the following, (i) Interference constraints: In every band, 
the set of allocated links must be non-interfering, (ii) Radio constraints: The total number of 
radios at each node is limited, and these radios are half-duplex, i.e., a link requires its end nodes 
to dedicate one radio each for a transmission to happen. More formally, the set of constraints 
are: 

<J u ,b(t) + *v,b(t) < l,V(u,v) G £ b ,Vb e B, (28) 
J2 a ^ ^ a^VjeAf. (29) 

i:j€{s(i),d(i)} b&B 

For a feasible schedule, the rate of flow supported on link i is 

n{t) = ^2cn,b(t)ci,bB b . 

beB 

We denote the vector of above rates by r(t). The throughput region T C IR™ is defined as the 
convex hull of the set of all feasible rate vectors. Note that the queue dynamics is exactly same 
as described in Section lU 



A. Distributed Algorithm 

In this section, we present an adaptation of the developed algorithm that is throughput- 
optimal for multiple-band multiple-radio scheduling. For simplicity, we assume that perfect and 
instantaneous carrier sensing is possible on every band. The scheduling vector corresponding to 
link i is crj(t) = {ex, t b(t)}beB- F° r this link, the possible states are 

{0i : 0i = {0 i>b } beB ,9 i>b E {0, 1}, ||0;|| o < mm{a s{i ),a d{i) }}. 

The link uses an independent exponential clock corresponding to each state with transition rate 
ex PEbe£ @bCi,bB b Vi) for state 6. Based on these clocks, the link obtains cr^t) as follows: 
1) If the clock associated with a state (say 0) ticks and transitioning to that state <Xj(t) = 



is feasible il then tTi(t) is changed to 0; 
2) Otherwise, cr^t) remains the same. 



'This is determined using carrier sensing and radio constraints at the source and the destination of that link. 
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The above procedure continues. The parameter Vi is updated over time as a function of the 
queue-length Qi(t) as described in Section [nil This makes the algorithm completely distributed. 
The vector of {vi} ie c is denoted by v. 

In order to establish that this algorithm is throughput-optimal, we show a correspondence 
between it and the rate allocation algorithm in Section [Till Consider a fixed v. The above 
algorithm forms a Markov chain on the set of feasible states. Let S(t) denote the matrix formed 
by vectors {cj(t)} ig £, and S denote the set of feasible matrices satisfying (T28l) and ( |29l ). The 
transition rate from state S = {6i} i( z C to state S = {0i} ieC can be expressed as 

f(S,S) : if 1(0, ^ h) = 1, 
o, if £IU 1(0*^ 0*)>i, 



q(S,S) 
where 



f(S, S) = exp {^2^2 6i,bCi,bB b Vil(6i ^ 6 { 

\i=l b£B 

And, the diagonal elements of the rate matrix are given by q(S, S) = — Eses s^£?W> f° r 
all S G S. 

Now, the following lemma is immediate. 

Lemma 9: The Markov chain (S, q) is reversible and has the stationary distribution 

ex P (E"=i Ebee Oi,bCi,bB b Vi) 



7T V (S) 



exp (r(S) • v) 



Furthermore, this Markov chain converges to this stationary distribution starting from any initial 
distribution. 

The offered service rate vector under the stationary distribution is s v = J2ses 7r v(S')r(S')- 
Thus, we show a one-to-one correspondence to the rate allocation algorithm. As a consequence, 
we establish the throughput-optimality of the algorithm described in this section based on 
Theorem [2l 

VIII. Discussion & Simulation 

A. Determining Rate Feasibility 

Although our algorithm removes the control overhead associated with queue-length exchanges 
in the network, it still requires each link to determine rate feasibility. To elaborate, feasibility 
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implies data-rates of other links are not impacted, i.e., other links are able to maintain their data- 
rates in spite of the change in the given link's data-rate. Each link can possibly change its coding 
and modulation strategies to ensure this. A link can determine whether a data-rate is feasible if 
it knows the current set of data-rates associated with other links. An important fact that makes 
the algorithm of practical value is that a link needs to know only data-rates associated with 
those links that it interferes with. Therefore, in a large network, every link needs to learn data- 
rates associated with few physically near-by links from control messages, for example, through 
ACK/NACKs when ARQ is present. We refer to the process of determining rate feasibility from 
the interactions of physically near-by links as "channel measuring". This can be considered as 
a natural extension of sensing in CSMA. 

In order to further explain "channel measuring", we consider an example with a simplified 
physical-layer model. In this model, a transmitter can potentially communicate with a receiver if 
the receiver is within distance d . This transmitter can communicate at data-rate rj, 1 < j ' < k, if 
there are no other transmitters within distance dj to it. We consider r\ < r 2 < . . . < and do < 
d\ < . . . < dk- In this setting, for channel measuring, a transmitter needs to simply determine 
the distance of the nearest active transmitter. Even though we used an over simplified physical- 
layer model, this shows that channel measuring is a very natural technique for determining rate 
feasibility. Furthermore, it suggests that slightly more complicated schemes than carrier sensing 
may be enough to obtain significant throughput gains. 

For complex physical-layer interactions, we acknowledge that channel measuring requires a 
well-designed physical-layer control architecture, which, by itself, is a fairly non-trivial problem. 
However, radios that perform complex physical-layer signaling are increasingly common and each 
node has access to current channel interference level, information from beacons, pilot signals 
and its own location. These will definitely help such radios to perform channel measuring using 
existing physical-layer control overhead. 

B. Algorithm Parameters 

In this paper, we show that the algorithm provide throughput-optimal performance for par- 
ticular choice of algorithm parameters. Although this has significant theoretical value, these 
parameters may not be directly suitable in practice. In particular, we may have to limit the 
update interval length and attempt rates as large values of update interval can result in large 
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Time (t) 

Fig. 4. Queue-length trace from simulation 

queue-lengths, and large attempt rates can result in frequent changes in data-rates. There are 
certain hardware and physical-layer coding limitations on frequently changing data-rates, and 
frequent attempts lead to increased sensing/measuring overhead. These limitations can be easily 
dealt with through modified algorithm parameters. 

Our approach in the paper motivates a more general class of algorithms that can be throughput- 
optimal for appropriate choice of parameters. We can consider the general class with update rule 

Vi(n + i) = h (vi(ri), Xi(l) - Si(l)j 

for some function h(-). Next, we provide a "good" choice of this function based on simulation 
results. 

C. Simulation 

Consider the same Gaussian multiple access channel example with two links as before. This 
is shown in Figure [TJ This is simply an illustrative example to show scheduling over multiple 
data-rate levels. Similar simulation results apply for any number of users. Let the average power 
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constraint at the transmitters be P = 3 and noise variance at the receiver be N — 1. The 
information-theoretic capacity region of this channel is the pentagon shown in Figure [2] where 
C(x) = 0.51og 2 (l + x). The set of rate levels chosen by both transmitters are {0,a,b} where 
a = 0.4 and b = 1. The only infeasible rate allocation pair is [1, 1]. Consider the following 
arrival processes at both the transmitters. At integral times, the queues are incremented by an 
i.i.d. Bernoulli random variable such that the arrival rate is A = p 2 ^ 2 , where p > represents 
the load in the system. Clearly, the network will be unstable for p > 1. 

For this system, we perform Monte-Carlo simulations with update interval T = 10 and update 
rule Viiji+i) = log(l + Q(ti + i)). This function results in linear update near origin and prevents 
the rapid growth of Vi with queue-length. We provide a trace of the queue-length process for 
p = 0.9 and p = 1.1 in Figure HI We observe that the algorithm supports 90% load in the system 
without large increase in queue-lengths. Intuitively, this symmetric operating point is one of the 
difficult operating points for a distributed algorithm. More importantly, the sum-rate p(a + b) 
obtained is close to the information-theoretic sum-capacity of this system. Thus, simulations 
show that our algorithm is of significant practice value. 

IX. Conclusion 

Decentralized algorithms that use local sensing-based information are highly desirable in 
practice for wireless networks. In this paper, we develop such an algorithm that guarantees 
throughput-optimality. Thus, we show that efficient network algorithms can be designed that 
fully utilizes underlying physical-layer schemes. The algorithm is of practical value due to its 
decentralized nature, and due to its applications both in the newly introduced channel measure- 
ment framework, and already existing carrier sensing framework. Since this paper improves the 
current state-of-the-art in distributed resource allocation to account for more complex resource- 
sharing constraints, it has applications in other areas as well, for example, in performing resource 
allocation in energy networks. The algorithmic framework in this paper can be used to perform 
utility maximization, i.e., adaptively choose the arrival rates at the links such that a certain utility 
function is maximized. 

The channel measurement framework introduced in this paper motivates further research. First, 
we need to better understand the feasibility of channel measurement with existing and newly 
developed radios. This needs development of good physical-layer architectures that minimize 
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the probability of inaccurate measurement and measurement delay. Further, we need to study 
the impact of imperfect channel measurement on throughput. 
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A. Optimization framework 

1) Proof of Lemma^i The steps involved are the following. First, we prove that, for any fixed 
A G , the objective function F(v, A) is strictly concave in v. Next, we show that for any 
fixed A e 1Z°, the optimal value v* lies inside a compact subset of W l . These two statements 
show the existence of a unique solution that is finite. This along with certain necessary condition 
for optimality completes the proof. 

For notational simplicity, we denote F(v, A) by -F(v) and the normalization constant or 
partition function by Z(y) := X] r erc ex P( r ' v )- Using calculus, it is straightforward to obtain 
the gradient (first-order partial derivatives) and the Hessian (second-order partial derivatives) of 
F(v) in the following form: 



2009. 



APPENDIX 



VF(v) 



A 




A 



s 



(30) 



H(F(y)) 



E nv [r)E nv [r T ]). 



(3D 
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Here, s v in (1301 ) is the offered service rate vector given by (fT3l) , and E„. v [$] := J2ren n ^( r )^ 
for any matrix, vector or scalar $. 

In order to establish that F(v) is strictly concave in v, we show that the Hessian H is negative 
definite, i.e., for any non-zero 77 £ 7£ n , rj T Hrf < 0. Since if is the negative of a covariance 
matrix, it is clear that is negative semi-definite, i.e., from (I3TT) . 



77^77 = -E^ [r/ T (r - E* v [r])(r - E^ [r]) T ?7] 



— E„ 



(^(r-E^ [r])) ; 



< 0. (32) 



We next prove that the Hessian i/ is negative definite by contradiction. Consider a fixed v. 
Suppose that there exists 77 7^ such that r) T Hr) = 0. Then, from (l32l) . it follows that the 
random variable rj T (r — E„. v [r]) is zero with probability 1. For any fixed v, all feasible states 
have non-zero probability. In particular, 7r v (0) > and 7r v (cjej) > for all i £ C. Therefore, 
the random variable must evaluate to zero at r = and r = Cjej, i.e., 

-rj T E nv [r] = ViCl - rj T E„ v [r] = 0, 

which implies 77 = 0. This provides a contradiction and establishes that the Hessian H is negative 
definite. 

Next, we prove that the optimal value v* belongs to a compact set. Let A + 5K1 £ 1Z C for 
some < 5 < 1. Note that for any A £ 1Z° there exists such a 5. Consider a v G K™. Define 

v m m = mhij-Uj, I = argmhij-Uj, and v max = maXj-Uj. Let 

A = A - mm(5K, A min )I(> rain < 0)e,. 

Clearly, A + mm(5K, A m ; n )l £ 1Z C , and hence, there exists a distribution \i on 1Z such that 
A + mm(5K, A min ) = E M [r]. Since A < Kl, we have 

« < A + mm(5K, A min ) = /i(r)r 

~ 1 + mm(5, Xmin/K) ~ ^ 1 + min(5, X min /K) 

and 

/i(r) 1 



. + min(5, A min / K) 1 + min(<5, A min / K) 



< l min(^A min /ir) 
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From (|33l ), (1341) and the fact that 0, G 7?., it follows that there exists a non-negative measure 
ft on 1Z such that A = J2 re1 iK r ) r wml X] r e7eM r ) = ^ — 0.5min(5, X mia /K). Now, define a 
distribution 

' /i( Q e,) + min( ^ A 4 - //?) I(tWn < 0), if r = Cl e h 



AW 



A(0) + g(M ( 2 _ l( Vmm < 0)) , if r = 0, 
/2(r), otherwise. 



Define A = E^[r]. Now, we have 

A = A - (l - min(5A', A min )I(> mm < 0)ej. 
Clearly, A ■ v < A ■ v. Substituting these inequalities in (fl"5l ), we obtain 

F(v) = A-v-logZ(v) 

< A • v — log Z{\) 

W . », exp(qe z -v) „ exp(0 • v) 

< mm fi(ciei) log —— , /i(0) log 



Z(v) & Z(v) 

W / min(<5, A fflin /K)I(u min < 0) exp(A^ min ) 

< mm log , 

V 4 & 1 

min(<5, A min /K) 1 A 

log — r . (35) 



4 exp(Kv n 

Here, (a) follows from exp(r • v) < Z(y) for any r E TZ, and (b) follows from K^< Ci < K 
for any i E C. Let v* = sup vgR n -F(v). Then, by definition, F(v*) > F(0) = — log |7£|. From 
(1351) . we obtain the bounds 

» 4 log |ft| 

V ™ < y ■ 77 7 77>V ( 36 ) 



and 



Thus, there exists a unique solution which is finite. Finally, the necessary condition in (1301) for 
optimality completes the proof. ■ 



^ 4 log \K\ 

mm ~ K mm(6, A min /A') ' 
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2) Proof of Lemma\5\- The first part of the proof follows directly from Lemma |4l The second 
part also follows from the proof of Lemma |U as explained next. In the proof, replace A with 
A + |1 and choose 5 = -~. Now from (1361) , (1371) and ©, we obtain 

AnK log \2K/e] 1 
v* oo< . r e \ \ (38) 

This follows from K < K. If e < 4A min , then @ simplifies to d23]). ■ 

B. Mixing within update interval 

1) Proof of Lemma Consider the matrix P = exp(P — I). It is fairly straightforward 
to verify that P corresponds the probability transmission matrix of a reversible Markov chain 
with the same stationary distribution 7r v . Now, the steps involved to complete the proof are the 
following. We need to obtain a lower bound on the conductance associated with P and apply 
Result |2l Then, we can apply Result \T\ to P at r = [At\ . 

From (fl~4~l) . 7r v (r) = (exp(r • v))/Z(v), where the partition function 

z ( v ) = J^exp(r • v). 

From ©, it is clear that Z(v) < \2K/e\ n exp(Kn||v|| 00 ). In addition, exp(r-v) > exp(— ^n||v|| 
Therefore, for all r 6 1Z, 

, , exp(— 2X721^1100) 

Consider two states that differ in one dimension, i.e., r, r G 1Z, ||r — r|| = 1, then the 
transition probability P(r, r) is lower bounded by the product of the probability that a Poisson 
random variable with parameter 1 is one and P(r, f). This follows from the fact that these two 
(independent) events together contribute to the transition probability P(r, r). Hence, 

P(r,r) > e^ 1 P(r,r) 
„-i/( r >r) 



> 



A 

exp(— 2A'||v| 



ne 

where /(r, f) is given by (l24~l) and A = n exp(X||v|| 00 ). To lower bound conductance in ([8]), 
the following observation can be used. If both S and S c are non-empty, then there is at least 
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one state in S and another state in S c that differ in one dimension alone. This follows from the 
fact that the state-space is connected through these one dimensional transitions alone. Applying 
this, we obtain 

exp(-2i?(n + 1)1^1100) 



$ > 



(40) 



ne \2K/e\ n 

Using ©, and substituting (|40l) , ( |39l ) in ©, we have the required result \\n(t) — 7r v || r y < p x if 

t = exp (6 f nllvlloo + nlog - J J log — . 
V V e// Pi 

This completes the proof. ■ 
2) Proof of LemmaXh In the proof, we suppress I in the notation, denote s v by s, and denote 
7r v by 7r. From triangle inequality and linearity of expectations, we have 



E 



A(0 - A 



E 



n 

|s(Z) - s v (Z)|| 1 ] < [|A, - A,| 

i=i 

n n 



+ 



Isi-EtsilH + ^Rsil-Sil. (41) 
i=i i=i 

Now, we focus on z-th link and upper bound each of the three terms on the RHS of (|4T|) 
corresponding to this link separately by pij'&n. 

For bounding the first term in (|4Tj) . denote the arrivals over integral times as {£fc}fe=i- From 
our assumption on arrival processes, these are i.i.d. random variables with variance at most K 2 . 
Hence, 



E 



A,- — A,' 



< 



< 




(A; - \if 



(42) 



Next, we consider the expected offered service rate under distribution /x(£), where fj,(t) denotes 
the distribution over 1Z given by the algorithm at time t. From (fT3l) . we have 



IE 



< 2J?||/i(t) - 7r|| ry . 



(43) 
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If we look at two times z and y such that < z < y, then 

E[ ri (z)n(y)] = ElnWEinMlniz)]] 

< E[r i (z)]maxE[r i (j/)|r i (z)= / 9]. 



(44) 



We use (|43l) and (l44l) along with Lemma [6] to obtain bounds on the last two terms in (l4TT) . Let 
-B(pi) be large enough time such that it satisfies (T26l) . 
For the second term in (14TT) . using ©, we have 

(E[|S l -E^]|]) 2 <E[(s i -E[^]) 2 ] 
= E [(s t ) 2 } - (E[s t }) 2 



E 
1 

2 

y2 



i jf r^dz) - (e ~jf ri (*)dz ) 



JO 



</z 



(E [r, (2)^(2/)] - E [r^)] E [n(y)]) dydz 



(E [r^r^)] - E [n(z)] E [ ri (j/)]) dj/dz 



<^J E[n(z)]idz, 



(45) 



where the inner integral 

I 



T 



I maxE[ri(y)\ri(z) = (3}—E [r^y)} J dy. 



Here, we used ([44]). Now, from (1431) and Lemma[6]on mixing time, both max^g^ E[ri(y)\ri(z) = 
(3\ and E [rj(y)] are close to s, by total variation p\ each if y > z + B(pi). Formally, we bound 
j as follows: 

°z+B(jn) 



I < 



Kdy+ / ^piKdy 

Jz+B{pi) 

< B( Pl )K + 4 Pl KT. 



(46) 



Substituting d46Jin d45j), we obtain 



E [\§i — E[si]\] < (— / E[r t (^]( J B(p 1 )i? + 4p 1 KT)dz 



o 

< (^ 2 S( Pl ) + 8^ 2 pi X2 



(47) 



where we used E[r,(^)] < K. 
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For the third term, from © and ( |43l ) and using techniques applied above, we obtain 



\E\si] 



< 



1 f T 

— / E[ri(z)\dz - Si 
KB fa) 



T 



2Kp 1 . 



(48) 



With px = p 2 2 /(\AAn 2 K 2 ) and the choice of 



T = exp ( 6 ( rallvHoo + n\og^j \ y, 



it is fairly straightforward to see that RHS of (1421) . (1471 ) and ( |48l) can be made smaller than 
P2/3n. This completes the proof of Lemma [7J ■ 



C. 'Drift' over multiple intervals 

1) Proof of Lemma \8j; For simplicity, we denote v(r;) by v;. Define G(v) := -F e (v) — ||v — 
v* |||. Let [0] D denote component-wise [9i\r>. This function has the following monotone property. 
The proof is given later in this section. 

Lemma 10: Consider any v e [-D, D] n , Av e [-1, If. Then, G([v + Av]u) > G(v + Av). 
Also, > G(v) > -7nD 2 . 
Let the error term in the /-th time interval be 

e, = (A(0 - ~ (A - s Vi ) 

and e; = a(V-F e (vz) + e;). From Lemma the update equation in © can be written as Vj+i = 
+ ej. We have VF e (v,) e [-K,K] n , e t e [-K and vj, v* e [-D, D] n . Therefore, Ue^oo < 
a(2K + K) < 1. From Lemma flOl and Taylor's expansion, we obtain 

G(v,+i) = G([v z + ej] D ) 
> G(v z + e,) 
= F e (v, + e,) - ||v, + ei - 
= G(v,) + VF £ (v ( ) • + -e,ife, 

-||e,||2-2(v I -v*)-e I , (49) 

where H is the Hessian of F e {-) evaluated at some v around vj. The elements of the matrix if 
belong to [-K 2 ,K 2 ], e L e [-K, K] n , VF e (v t ) e [-K, K] n and V/ ,v* e D] n . Therefore, 
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| e z 1 1 oo < a(2K + K). Using these, we have 

1 



-eiHe t - \\ei\\l > -a z c, 

where c = (2A + Kf (^f- + . Since F e (v) is concave with optimum v*, 

A e (v*) < F e (v,) + VF e (v,) ■ (v, - v*). 

It follows that VF e (vj) ■ (v/ - v*) > 0. Applying these to (|49l) . we obtain 

G(v,+i) > G(v l ) + a\\VF e (v l )\\ 2 + aVF e (v l )-e l -a 2 c 
-2a(v, - v*) • VF e (v,) - 2a(v ; - v*) ■ e,, 

> G(v,) + a||VF e (v,)||l - atf||e,||i - a 2 c 
— 4afZ)||ei|| 1 , 

> G(vi) + a||VF e (v,)||£ - 5a£>||e,||i - « 2 c. 

Here, we used K < D. 

Next, performing telescopic sum and then using G(vi) > —7nD 2 from Lemma [TOl we obtain, 

N 



G(v N+1 ) = ^(G(v m )-G(vO) + G( Vl ) 



z=i 

AT AT 



> a^||VF e (v0ir 2 -5^^||e 
-a 2 cN - 7nD 



i=i i=i 

2„Ar I-? „ 7-)2 



Since G(vn+i) < 0, and then applying dTTT) . we get 



7nD' 



7nD 2 

< 5£>p 2 + ac+— — . (50) 
aiv 
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Applying Cauchy-Schwarz inequality, we obtain 

N N 



l^E[VF £ (v,)] < i^E[||VF e (v,)|| 2 ]l 

1=1 1=1 



< 



< 



\ i=i 



N 



\ 4E E 0|VF e (vO||I]l 

\ 1=1 



7nD 2 

< \/5Dp 2 + ac+—^l. 



(51) 



Next, we look at the average of the empirical service rates over N update intervals. From 
(T27T) and Lemma \5\ we obtain 

N N 

-£>[s(Z)]-A = -^E[s Vi -A + s(/)-s v 



i=i 



3 v,J 



1=1 

N 



> 



s Vi - A] - p 2 l 



-Ye 

i=i 
1 N 

-$: E [ii-vF, ( v, 



P 2 1- 



1=1 



Substituting (1511) and proceeding, we obtain 



i=i \ 



7nD 2 

^occ+ — -p 2 |l. 



Now, choose p 2 = 5^75- Then, 



5-Dp 2 + ac + 



7nL> 2 

aN 



e 2 e 2 e 2 
35 + 35 + 35 




(52) 



3 4 9 

It is easy to check p 2 + § < |. This completes the proof. ■ 
2) Proof of Lemma ITUj- Let v = v + Av. Clearly, HvH^ < D+l. In order to prove G([v]£>) > 
G(v), it is sufficient to prove the following. For any dimension i e £, G([v]z),i) > ^(v), where 
[v]u,i is defined as: the z-th component of [v]^ is same as the i-th component of [v]d, and 
all other components of [v]^ are same as the corresponding components of v. It is sufficient 
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to prove this as we can repeatedly apply G([v] Dti ) > G(v) along all dimensions to obtain 
G([v}») > G(v). 

Consider any i E C If i)i E [—D,D], then GQv]^) = G(v). Therefore, the only non-trivial 
cases are Vi E (D,D + 1] and Vi E \—(D + 1), —D). We consider these cases separately, and 
apply \dF e /dvi\ < K, and Hv*^ < D — K. For v t E (D, D + 1], we have 



The other case follows from similar arguments. 

Since F £ (v) < 0, clearly G(v) < 0. Next, we obtain a simple lower bound on G(v) as follows: 



G([v] Dti ) - G(v) 



> -K(vi — D) + -D){vi + D- 2v*) 



> (vt - D)(-K + Vi + D- 2v*) > 0. 



G(v) 




> -KnD - log ( \2K/e] n exp(KnD)) 
= -n (2KD + log \2K/e] + AD 2 ) 



n{2D) 2 



-7nD 2 . 



This completes the proof. 
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